A Telepresence System by Using Live Video Projection of a Wearable Camera onto a 3D Scene Model

In this paper, we propose a novel telepresence technique that has the advantage of both model-based and imagebased approaches. In this technique, a virtual environment representing a remote place is presented by using projection texture mapping of live video images captured by a wearable camera onto the 3D geometry of the remote place. The 3D geometry is acquired in advance. The virtual environment can be rendered from an arbitrary viewpoint, while its texture is dynamically updated according to the camera motion. The observer can then observe the remote place in cooperation with the remote camera man. The prototype system shows the validity of our approach.